Underwater image projection system and method

ABSTRACT

An underwater projection system includes a controller designed to generate a map based on the boundary of a projection area, receive image content, and generate a control output based on the image content and the map. A projector is in communication with the controller to project the control output through the fluid onto the projection area.

RELATED APPLICATIONS

This application is a continuation of U.S. patent application Ser. No.15/805,973, filed Nov. 7, 2017, which is a continuation of U.S. patentapplication Ser. No. 15/174,750, filed Jun. 6, 2016, now U.S. Pat. No.9,813,684, which is a continuation of U.S. patent application Ser. No.14/618,946 filed on Feb. 10, 2015, now U.S. Pat. No. 9,360,746, which isa continuation of U.S. patent application Ser. No. 13/626,867, filed onSep. 25, 2012, now U.S. Pat. No. 9,134,599, which claims priority toU.S. Provisional Application No. 61/678,606 filed on Aug. 1, 2012, theentire contents of which are incorporated herein by reference.

COPYRIGHT NOTICE

Portions of the disclosure of this patent document contain material thatis subject to copyright protection. The copyright owner has no objectionto the facsimile reproduction by anyone of the patent document or thepatent disclosure, as it appears in the U.S. Patent and Trademark Officepatent file or records, but otherwise reserves all copyright rightswhatsoever.

BACKGROUND

In the field of image projection, a number of obstacles are provided toaccurate projection of images, especially images on a non-uniformsurface. This is further compounded when the image is projected in onecomposition or fluid environment and the observer is located outside ofthis composition or fluid environment. Or similarly, when the projectionof the image and subsequent observation of the image are made in onefluid environment and the projected image target is in another fluidenvironment, resulting in unacceptable distortion. An example of thisdistortion can be seen when one observes fish in a body of water, theposition of the fish observed is distorted as is the size and sometimesshape of the fish from a vantage outside the water. Additionally, inprojecting images in the interior of a body of water like those in waterfeatures or in targeted natural water settings, such as but certainlynot limited to pools, fountains, spas, sand bars, and the like, surfaceirregularities make correction in combination with the distortioneffects difficult.

Some of the technical difficulties and issues in projecting images inthese locations include accommodating the variables of transmissivitywithin the body of water, the variations between the transmissivity ofthe water and the interface with air and the location of an observeroutside of the body of water, undulating contours and angles within thebody of water and in the surfaces being projected upon within the bodyof water, observational variations based on the position of theobserver, and similar variables which must be accommodated to provideideal image viewing.

As such, a need exists for a projection system, a projection systemcontroller, an underwater projection system, an underwater projectionsystem controller, a computer enabled apparatus for controlling aprojection system and/or an underwater projection system, a method ofcontrolling a projection system and/or an underwater projection system,and a method of controlling and adjusting a projected image thatovercomes these challenges and provides a robust image quality in aprojected image with control of the projected light and, potentially,additional lighting. An in-situ projection system with user observedimage control and correction is needed to address the myriad ofcomplexities in projecting such quality images.

SUMMARY

Some embodiments provide an underwater projection system for a waterfeature. The underwater projection system includes an underwaterprojector and a system controller in communication with the underwaterprojector. The underwater projector is configured to project an imageonto an underwater surface of the water feature. The system controlleris configured to receive image content, manipulate the image content togenerate a control output, and communicate the control output to theunderwater projector. The underwater projector is configured to projectthe image based on the control output.

Some embodiments provide a method of projecting images onto anunderwater surface of a water feature using an image projection system.The method includes receiving image content and projecting a first imageonto the underwater surface. The method also includes receivingadjustments to one of a projection area and an image deformation basedon the projected first image, and projecting a second image onto theunderwater surface based on the image content and the adjustments.

In other embodiments, an underwater projection system includes acontroller designed to generate a map based on the boundary of aprojection area, receive image content, and generate a control outputbased on the image content and the map. A projector is in communicationwith the controller to project the control output through the fluid ontothe projection area.

Further embodiments include an underwater projection system having aprojector to project images onto a projection area. A controller is incommunication with the projector and is designed to transmit boundaryshapes to the projector for projection onto the projection area, receiveboundary shape placement information, determine a projection areaboundary based on the boundary shape placement information, generate acorrection map based on the projection area boundary, receive imagecontent, generate a control output based on the image content and thecorrection map, and transmit the control output to projector forprojection onto the projection area.

Additional embodiments include a projection system for underwater use ina water feature having a projector to project images onto a projectionarea, a sensor to generate boundary information of the projection areaand a controller in communication with the projector and the sensor. Thecontroller determines a projection area boundary based on the boundaryinformation, generates a correction map based on the projection areaboundary, receives image content, generates a control output based onthe image content and the correction map, and transmits the controloutput to the projector for projection onto the projection area.

DESCRIPTION OF THE DRAWINGS

FIG. 1 shows a plan view of a water feature with underwater projectionsystem according to one embodiment;

FIGS. 2A-2C show the application of a boundary mapping system for theunderwater image projection system;

FIG. 2D shows a plan view of a further embodiment of the instantinvention incorporating an automatic data collection module andhardware;

FIG. 2E shows a plan view of a further embodiment of the instantinvention incorporating a further automatic data collection module andhardware;

FIG. 3 shows an embodiment of the input selection process for the edgeboundary operation into the boundary mapping system through a GUI by auser;

FIG. 4 shows the operation of the underwater projection system andresulting deformation due to the water feature variables and correctiontaken by the underwater projection system;

FIG. 5 shows an embodiment of the GUI of the instant invention operatingon a projected test image;

FIG. 6A shows a system component or module view of the controller of theinstant invention;

FIG. 6B shows a further system component or module view of thecontroller of the instant invention with an automated data collectionmodule; and

FIG. 7 shows a view of a first and second of an at least two underwaterprojection systems simultaneously operating.

DETAILED DESCRIPTION

Before any embodiments of the invention are explained in detail, it isto be understood that the invention is not limited in its application tothe details of construction and the arrangement of components set forthin the following description or illustrated in the following drawings.The invention is capable of other embodiments and of being practiced orof being carried out in various ways. Also, it is to be understood thatthe phraseology and terminology used herein is for the purpose ofdescription and should not be regarded as limiting. The use of“including,” “comprising,” or “having” and variations thereof herein ismeant to encompass the items listed thereafter and equivalents thereofas well as additional items. Unless specified or limited otherwise, theterms “mounted,” “connected,” “supported,” and “coupled” and variationsthereof are used broadly and encompass both direct and indirectmountings, connections, supports, and couplings. Further, “connected”and “coupled” are not restricted to physical or mechanical connectionsor couplings.

The following discussion is presented to enable a person skilled in theart to make and use embodiments of the invention. Various modificationsto the illustrated embodiments will be readily apparent to those skilledin the art, and the generic principles herein can be applied to otherembodiments and applications without departing from embodiments of theinvention. Thus, embodiments of the invention are not intended to belimited to embodiments shown, but are to be accorded the widest scopeconsistent with the principles and features disclosed herein. Thefollowing detailed description is to be read with reference to thefigures, in which like elements in different figures have like referencenumerals. The figures, which are not necessarily to scale, depictselected embodiments and are not intended to limit the scope ofembodiments of the invention. Skilled artisans will recognize theexamples provided herein have many useful alternatives and fall withinthe scope of embodiments of the invention.

The instant invention is directed to an underwater projection system andcontroller for configuring and controlling image projection in situ.Water has a different refractive index from air that adds to the opticaldeformation of the light as it exits a lens surface if it is out of thewater, thus in-situ projection simplifies the necessary corrections. Inthe exemplary embodiment, both the boundary setting and the imagecorrection modules of the controller are executed underwater so that theperspective distortion correction from projector to target is avoided.Thus, in-situ projection reduces the complexity of the correctionsapplied by the controller. Additionally, the boundary measurements andcorrections of the exemplary embodiment of the instant invention beingapplied in-situ provides consistency and ease of operation. The userviews the image at the target as projected in situ and applies thecorrections as outlined below from outside the water. Thus, the focus ofthe projection system is set so that the water is in contact with theexterior lens and participates in the final optical manipulation. In theabsence of the water in contact with the lens, the size, position, andfocus of the objects are different and requires further adjustmentcalculations, which can be added in additional software in furtherembodiments of the instant invention. However, the exemplary embodimentof the invention described herein is directed to an underwaterprojection system. As water features often have complex geometric shapesthat cannot be easily modeled onto software, this approach of in-situprojection with a user observing and guiding corrections from outsidethe water feature allows the user to simply move markers to specificpoints, thus defining the boundary point by point and applyingcorrections across the defined boundaries as observed without thevariation from the projector being out of the water. Thus, the exemplaryembodiment provides a novel control function for an underwaterprojector.

FIG. 1 shows a plan view of a water feature with underwater projectionsystem. The system includes a user interface, in this case a graphicaluser interface (GUI) 400 that communicates, either through a wiredcoupling 110 or wireless coupling or through a network, with a systemcontroller 120. The system controller 120 controls an underwater imageprojection system 100. The underwater projection system has a lens (notshown) that is in contact with the water 220 of the water feature 210.This system projects an image 520 into the confines of the water feature210 under the water 220. In this instance the water feature is a pool,however, the system may be used in fountains, pools, Jacuzzis, ponds,from the hull of a boat into a natural lake or ocean with a sand bar, orsimilar underwater uses. The control elements and software, describedherein below, may also be utilized in above water applications such astheatrical or live show presentations or similar displays. Similarly,reference is made to the GUI 400, here shown as a tablet typecomputing/communications device. However, the GUI 400 may simply be ananalog controller with buttons and an LCD interface for instance or LEDlights and a series of input buttons. The specific design of the userinterface may be varied to provide the necessary steps of boundarysetting and graphical variable corrections specified herein withoutdeparting from the spirit of the invention.

In addition to the image projection elements of the underwater imageprojection system 100, the exemplary embodiment shown also includesoptional ambient lights similar to conventional pool floodlights thatoperate in conjunction with the image projection elements of theunderwater image projection system 100 to provide optional ambientlighting effects 510. Although shown as a single device, the combinationof the underwater projection system with an at least one ambient light(not shown) operating in a further installation is embraced in theinstant invention or combined in similar manner. The underwaterprojection system 100 may also be operated independently without ambientlighting. Similarly, multiple underwater projection systems 100 workingin the same water feature 210 are contemplated, as better seen in FIG.7.

In addressing the unique nature of projecting a two dimensional image onthe non-uniform surface of most water features 210 it is necessary forthe system controller 120 to operate a visual correction system inprojecting images in motion in the water feature, along the waterfeature, and images appearing around the surface of the pool or waterfeature 210. To this end, the software or modules residing on thecontroller 120 include an at least one boundary mapping routine ormodule for the image projection surfaces within the pool in conjunctionwith or operating independently from an at least one correction routineor module for correcting the projected images.

FIGS. 2A-2C show the application of a boundary mapping system for theunderwater image projection system. The system projects through theunderwater image projection system 100 a series of boundary patterns. Inthe embodiment shown, these are represented by the projected boundaryshapes 351-358, labeled A-H in FIG. 2A. The system, in this exemplaryembodiment, utilizes the underwater projection system in step by stepfashion to project each boundary patterns or projected boundary shapes351-358 sequentially. This is exemplified in FIG. 2B, where a singleboundary image is being displayed in conjunction with the operation ofthe GUI 400 in a manner as shown and described in FIG. 3. In thisinstance boundary image “H” 352 is being shown in its placement withinthe water feature 210 as shown. The underwater projection system 100 isshown projecting the boundary image “H” 352 in the water feature. Aframe 350 is shown representing the maximum extent or size of projectionthat is possible directly from the primary modulation or steering device(not shown); in this instance the total projection size is directlylimited from the projection source aperture to a discrete portion of thewater feature 210. The secondary modulation or steering device (notshown) allows for the frame 350 to be moved allowing for subsequentprojection of other shapes in other parts of the pool such as thevarious locations shown in FIG. 2A of boundary shapes 351-358.

FIG. 2C shows another exemplary embodiment of the instant invention. Asseen in FIG. 2C, in a further exemplary embodiment utilizing anotherform of projector with sufficient projector aperture to be able toproject within a larger section of the boundary of the projection areaat once, the controller 120 may project multiple selected boundaryimages at once, here shown as boundary images “A” 353, “B” 354, and “C”355. In this instance, the aperture size of the projector in projectionsystem 100 is sufficient that there is no secondary modulation necessaryto project into the water feature 210. In this case, multiple boundaryimages 353-355 can be projected. Similarly, if the image aperture of theprojector is sufficiently large, up to all the boundary images may beprojected at once.

Though a shape is shown, here a right angle corner, the shape of thetest images shown in the figures is not exhaustive of what may be used.The test image simply needs to be discernible by the user and/or thesystem and implemented in the drawing of the boundary. Additionalintermediary steps may also be utilized and additional correctivevariables may be analyzed as input by a user or sensed through a seriesof sensors. The placement, timing and display as well as the datacollected, stored, programmed, or utilized for calculations and/orcompensations may be varied without departing from the spirit of theinvention and the order shown is provided as a non-limiting example.

The process of placing each projected boundary shape 351-358 in theexemplary embodiment shown is similar in each instance. Again, referenceis made to the stepwise exemplary embodiment displaying each projectedboundary shape 351-358 in sequence and adjusting placement individually.This is further illustrated in an obstruction in the display area of thewater feature is shown here as 230, a Jacuzzi or similar obstruction forexample, that is dealt with by implementing an at least one additionalmarker 360, here shown as multiple markers “E” 357 and “F” 358, toaccommodate the changes in the boundary necessary due to theobstruction.

Further additional markers can be added as necessary to outline thedisplay boundary line or edge 370. In other non-limiting examples, forinstance, this type of variation could also simply be caused by theshape of the pool or water feature or could encompass additional waterfeatures or other similar obstructions. Additional markers 360 could beused to compensate for these obstructions as well or further additionalmarkers, which could be added to adjust the boundary. These types ofobstructions can be typically found in a water feature installation suchas pool. Similar obstructions may also occur in other types of waterfeatures and bodies of water, for instance water fountains from nozzles,waterfalls, level changes, and similar design aspects of most waterfeatures need to be accommodated. Additional obstructions may also bepresent in naturally occurring environments, such as, but certainly notlimited to, those found on sand bars and jetties from rock outcrops andthe like. The instant invention allows for adjustment of the underwaterprojection system 100 projection boundary 370 to compensate for theseobstructions, like 230, as shown through the boundary setting componentwith flexible input of any number of additional marker elements 360.

Each boundary pattern or projected boundary shape 351-358 is selected bya user 450 through the GUI 400 as further described in relation to FIG.3. The boundary shapes may be presented to the user as a drop down menu,a graphical menu, or any other appropriate display for a variety ofmorphable or user configurable shapes. These shapes are mutable andmorphable or configurable by the user into the desired boundary of theprojection area. In this instance, a series of corners and straights areprovided and placed by the user 450 with the aid of the GUI 400 bymorphing or configuring a selected boundary shape, for instance thecorner shown, to define the projection field or area edge or boundary370. When selected, the boundary pattern or projected boundary shape351-358 is selected and moved to a selected edge or boundary orperimeter 370 and fit to define various contour points. In thisinstance, the projected test shape “A” 353 is projected to a corner andthe shape is configured as a right angle. Additional methods ofinputting shapes and outlines can be provided and will function toprovide the necessary guidance for boundary setting in the underwaterprojection system. For instance, using a pen or stylus to draw aboundary and then interpolating that boundary on a picture of thedesired area is just one further example of boundary definitionprocesses that might be utilized. The result being, as shown in FIG. 2A,the image boundary 370 is defined by user input to select and placelimitations defining the boundary.

FIG. 2D shows a system view of a further embodiment of the instantinvention incorporating an automatic data collection module andhardware. As seen in FIG. 2D an automated data collection module 730can, as best seen in FIG. 6B, also be incorporated in a controller, forinstance system controller 120, and hardware including an at least onesensor 512. This can include an edge detection system that can, but iscertainly not limited to, determine the shape of the pool. Anon-limiting example of such a system would be one that utilizes apassive sensor to determine variations in the received amount of anenergy, such as light or sound, and to produce a gradient which can thenbe utilized to define and edge or through color variations from a videoimage. One non-limiting example can be, but is certainly not limited to,an infra-red sensor or camera which can detect the absorption gradientaround the water feature to define the water features actual edges forthe display for instance. Similar cameras or sensors in differentspectrums could be utilized in conjunction with, or alternatively, tosuch a system to aid in automatically detecting the initial shape of thewater feature for the user. These would generally be classified aspassive type sensors, capturing reflected light or sound for instance toprovide data.

FIG. 2E shows a further embodiment of the instant inventionincorporating another embodiment of an automatic data collection module.Another type of system that might be utilized is an active mappingsystem using infrared or other active emissions to determine depth anddimensions. In these instances, the controller, here again the systemcontroller 120 for example or the user interface 400, utilizes furthersoftware modules and/or hardware to facilitate image capture ortransmission of data pertaining to the water feature. An at least oneactive emitter 517 with an at least one sensor 519, for instance butcertainly not limited to an ultrasonic or LIDAR type system, using theat least one emitter 517 above or in the pool to detect distance andshape in conjunction with one or more sensors 519 acting as receivers.In this type of system, the data can be interpreted based on thelocation of the at least one sensors 519 to the at least one emitter 517to determine both edge dimensions and changes in the underwater surfacesof the water feature 210. In both FIGS. 2D and 2E, these systems can becoupled to the instant invention to provide pool shape and size datausing an automated data collection module on a controller.

In this way, the additional modules including the automated dataacquisition module 730 can capture the information when instructed andcreate a boundary line 370 setting for the underwater projection system100. This purpose can be served with other sensors such as ultrasonic orLIDAR or other active or passive sensors as noted. Generally, if thedata acquired is to be for the projection border component of theprojection border and image correction routine module 610, a passivesystem to detect the edge of the pool or a passive system alone or inconjunction with an active system can be utilized. This data could thenbe coupled to the projection border and image correction routine module610 to set the edge of the water feature and then define a projectionarea in the boundary as noted above in relation to FIGS. 2A-2C, withadjustment by the user 450.

An active sensor can also be used for more detailed analysis of thesurfaces and an improved initial boundary and projection areadetermination for the projection border and image correction routinemodule 610. The can be, for example, but is certainly not limited to,providing data in the image correction portion of the module 610 toprovide the initial data points similar to the user driven setup orprovide for a more automated system for initially mapping the waterfeature and the projection points of test images. In addition, in astill further automated embodiment, a further camera or other imagesensing device (not shown) can be used to visualize the boundary imagesand automatically calculate the correction inputs in a manner similar tothe input from the user as explained above. By visual comparison, froman observation point that is then compared to a stored known targetimage by image comparison software.

The data from the automated data collection module 730 can be used inconjunction with the user 450, wherein steps similar to those of thepreviously disclosed embodiments correct the initial setup from theautomated detection modules. Alternatively, the existing modules mayfunction directly with automated data collection modules 730, providinga user 450 with a more simplified interface, allowing for simpledeformation on screen to “adjust” a final image projection determined bythe map generated by the boundary setting module and image correctionmodule using data from the automated detection module for instance.

In any case, the result of the process used is delineation in the poolor water feature or target of a boundary 370 within a body of water 220of a projection area 375 with a projection area boundary edge 370 forthe underwater image projection system 100 to project within and forwhich a correction map 620 is then defined for the water feature ortarget 210. In the exemplary embodiment disclosed herein, the GUI 400 isused to interactively shape the boundary such that the corner is openedto the dotted boundary line edge or boundary perimeter 370, as shown.The angle of the boundary line defined by this interaction that maps thecorner at the location of projected test shape “A” 353 in the pool. Afurther edge indicator projected shape is selected by the user 450 andprojected as a straight line “B” 354. This is placed as shown and theboundary 370 begins to be constructed by controller 120 joining, withoutdisplaying, the edges defined by the projected test shapes A and B 353,354. The system proceeds with the user 450 selecting and placingcomponents C-G in place 355-351 to define the edge boundary or boundaryline 370 of the projection system. The obstruction 230 is avoided byplacing the projected test shapes E and F in such a way as to modulatemorph or mutate the boundary around the obstruction 230. Each projectedtest image 351-358 is selected and placed by a user interacting with theGUI 400. This can include the use of a guided or step by step wizardprogram, as further discussed herein. This placement is stored alongwith the modulation, morphing or configuration of the selected imagesand a projection image display boundary 370 is set.

FIG. 3 shows an exemplary embodiment of the input selection process forthe edge boundary operation into the boundary mapping system through aGUI by a user. The GUI 400 displays a series of input selectors 430. TheGUI 400 is shown being utilized by a user 450. Touch selection andcontrol is shown in this exemplary embodiment, however, the instantinvention fully embraces both analog and digital input from other inputdevices including but not limited to sliders, switches, buttons,external interface devices, human interface devices, and the like forboth input and selection as well as execution of and interaction withthe GUI 400. Again, although a touch screen GUI is shown as best modeexemplary embodiment herein, a non-touch screen controller, for examplebut certainly not limited to a controller having a small LEDrepresentative screen and button inputs, is fully contemplated herein.Additionally, as noted above, parts of the input may be automatedthrough the use of certain edge boundary schema, including thermal orstandard spectrum video edge detection processes or similar machineenabled edge detections software.

As noted above, a “wizard” or prompting program is used in the exemplaryembodiment of the instant invention. The wizard guides the user 450through a series of onscreen prompts and proceeds through the process ofselecting boundary images and then adjusting these shapes to fit thewater feature. As shown, an outline of the pool 470 is projected on thescreen. This can be, for instance but is certainly not limited to, animage derived from direct input of the user, for instance by providing asubroutine to draw the pool shape and any obstacles or it can be from astored library of pool shapes or a further embodiment may utilize anactual picture of the pool using an edge detection algorithm to definethe shape or similar mechanisms for inputting the image of the shape ofthe pool 470 and displaying it on the GUI 400. This may be input by theuser or may be derived from operation of the GUI 400, such as operationof the GUI through a cellular phone with a camera or similar imagecapture device.

The user selects projected boundary shapes 351-358, as noted above inrelation to FIGS. 2A-2C, which are also displayed on the GUI 400 as GUIscreen test images 411-414 on the GUI 400 through touch sensitive screen440. Again, reference is made here to an exemplary embodiment utilizinga touch screen interface, the invention embraces input from all types ofhuman interface devices including keyboard, buttons, pointer devices,and similar human interface devices. The user selects, shown as anactive selection element or cursor 460, the projected boundary shapes onthe screen 440 and moves, as indicated by arrow 465, the shape, hereshape 414, to appropriate locations to outline changes in the boundaryfor the projection area boundary 370 as shown in FIG. 3. Similarly, asdiscussed in reference to FIGS. 2D and 2E, the system may use anautomated system to generate a boundary or generate an initial boundaryfollowed by user input to further correct the boundary.

Once placed, the GUI onscreen test image 411 is grayed out orun-highlighted, here shown as being in this state with a dotted line. Inthe exemplary embodiment shown, three of four of the GUI onscreen testimages 411, 412, and 413 have been placed and are unselected. User 450is placing a final GUI onscreen test shape 414 as shown by dragging itinto position on the screen 440 a progress bar 420 is shown providesprompts and shows steps or percentage to completion. An additionalprompt (not shown) would prompt user 450 to the next software module.This may include the deformation correction module or a further modulefor operating the pool or the underwater projection display system 100or a related system. However, to operate properly in an underwaterenvironment or in projecting on a non-uniform surface, the underwaterprojection system of the instant invention should be able to compensatefor both variations in the projected image surface, variations in fluidvariables and variations in positional variables within the waterfeature or target projection area.

FIG. 4 shows the operation of the underwater projection system andresulting deformation due to the water feature variables and correctiontaken by the underwater projection system. In this instance, theunderwater projection system 100 is shown in a water feature, in thisinstance in the standard light niche of a pool, projecting a testpattern or image 310 into the pool and onto the bottom of the pool. Abody of water 220 is provided and the refractive nature of the water incombination with the irregular shape of the most pool bottoms leads to adeformation of the projected image as viewed by the user. The projectiononto the irregular shape of the bottom surface of the water featurecontributes in large part to the distortion as well because theprojection source is not directly above the image plane. As a result,one end of the image is projected onto a surface that is closer to thesource than the other. The side that is closer has a smaller imagebecause the divergence is smaller. Again, a test pattern or test imagetarget shape 411 of known dimensions, shown here as a square, is used todetermine the amount of deformation in particular location in the poolbased on user 450 input on the screen to correct the projecteduncorrected image 320. The deformation correction is applied until theprojected uncorrected image 320 is transformed into an imagesubstantially similar to the corrected test image 330.

Reference is made below to an exemplary method of inputting thesedeformations by the user 450 through the GUI controller 400. Additionalmethods of input, interaction, and correction are also contemplated. Acomparison to target implementation is made here to compensate forvariables in both the shape of the projection surface and othervariables, some non-limiting examples being for instance those involvingfluid or transmission properties of the fluid or specific fluid flowcharacteristics, which are in the method described compensated fortogether. Other schema for determining variance in a projected imagecould include specific measurement and compensation for the variables inboth the projection surface and the projected media as well as spatialvariables. These could include triangulation and image distortion basedon calculations compensating for density, transmissivity, time of day,water temperature, surface composition, surface color, background color,and the like. In either case, the basic operation of the module willresult in an image correction or distortion adjustment/control map thatprovides a corrected image being projected from an underwater source toremain consistent as observed by a user of the projection system basedon corrections for observed and/or measured variables to the inputcaused principally by the projection within the water media, thenon-uniform target surface, and the spacial dynamics of a body of movingfluid that interfaces with a fluid of a different density that the pointof observation is located within.

In broadest terms, the user interface, here GUI 400, can be used toinput observations or sensed variables of the variance of theuncorrected projected image 320 of a known shape and these variances canbe used as corrections in the projection for that targeted area of thewater feature 210 across a defined projection area as set by a boundary.The process of entering the observed or sensed variances, for examplefrom a point outside the water feature, can be repeated through severalintermediary projected results until the projected image 310 is modifiedto compensate for projection variables and is thus transformed from theuncorrected image 320 to the corrected image 330. These corrections,once entered, can be stored and used during the operation of theunderwater projection system 100 to correct these variances in theprojected images as they are displayed in real time. The projected imagemay be a still image, a series of images shown as an animation, a video,or the like in any format readable by the controller as desired by theuser. More specifically, an animation or series of animations isspecifically embraced by the instant invention, which may include theuse of one or more projection elements or projection systems to providefor fully animated “shows” or features shown on the surfaces of theunderwater feature as desired by a user. Some specific examples wouldinclude, but certainly not be limited to, wildlife scenes,advertisements, animated caricatures, visually appealing geometricshapes and displays and the like.

In the exemplary embodiment shown, as best seen in FIG. 3, on the GUI400 touch screen 440 a display for each of the boundary locationscorresponding to the perimeter 370 of the underwater projection system100 projection as set by the user 450 through the GUI as disclosedabove, where the boundary area perimeter or line or edge 370 isgenerated and can be stored when the boundary module is executed. Thestored locations each have a target image 411 associated with thelocation and the user observes the distortion of the uncorrected image320, as best seen in FIG. 4, with the target image 411 on the GUI. Theuser 450 inputs the resulting projected uncorrected shape 320.Corrections are calculated based on the user input. Corrections areapplied and an intermediary image is shown to the user and the processof observation and correction repeats until a final corrected image 330corresponding to the known shape is shown.

FIG. 5 shows an exemplary embodiment of the GUI of the instant inventionoperating on a projected test image. In the exemplary embodiment shown,the GUI 400 is shown operating in the image correction mode. The GUI hasa touch screen 440. Again, reference is made to a touch screen and touchinput, however, one of ordinary skill in the art will understand thatthese inputs may be varied and any acceptable human interface devicesincluding but not limited to touch enabled devices, button inputs,keyboards, mice, track balls, joysticks, touch pads, and other humaninterface devices and the like. Each area of the projection area 375 orperimeter 370 as defined by the boundary settings operations like thosedescribed above in relation to FIGS. 1-4 is provided a test imageselection marker, and the user 450 selects a test image 411 on thescreen 440 as input. Each area is selected or woken by the user 450 froma hibernation state, as evidenced by the dashed lines, 481, 483, 484 andas each is set it goes dormant again. The active location 482 is shownon the screen 440 with the selected test image or target shape. Theknown target shape 411 can be projected on the screen and start as aregular shape, such as but not limited to squares, rectangles, octagons,and the like. The display on the screen of the user interface 400differs from the image shown, as seen in the FIG. 4. The user throughthe user interface takes the displayed image and distorts it to matchthe distorted or uncorrected image 320 shape seen in the targeted bodyof water 220, for instance a pool or pond or water featured. Alternativemethods of input such as drawing the image, as seen, or using a stylusor pen input or similar means of conveying the observed image are fullyembraced by the instant disclosure.

The objective is to convey what is seen by the user 450 so that a degreeof correction can be stored through the series of adjustments made tothe output image. These adjustments are then analyzed, stored, and theprojected image test pattern in the pool is updated as the adjustedfigure on the screen. This is continued until the target shape 411projected on the screen is satisfactorily met in the projection withinthe pool, as seen in FIG. 4, as the corrected image 330.

In this exemplary embodiment, the operating parameters are adjusted formultiple locations represented by the displayed test figures or images481-484. Again, these are used as the target for the user inputuncorrected shape 411. Once all the corrected shapes are achieved andthe data is stored, a calibration table or correction map is compiled bythe controller. In cases where the input is sequential, the correctionmap 620, as shown in FIG. 6, can also interpolate as between the pointsused for the input to establish the correction needed to maintain theaspect ratio of a projected image moving within the water feature. Thisinformation is shared and used by the Dynamic Content Manipulator (DCM)system 640.

The calibration table or correction map 620 is stored by the controller120 as best seen in FIG. 6. The storage of the data may be in volatileor non-volatile storage. In the exemplary embodiment, the storage of thecorrection map 620 is in non-volatile memory, indicated as storage 600,on the controller. This allows for recall of the map without the need torun the correction routine or module at every startup of the underwaterprojection system 100. However, if the correction routine or module isnecessary, for instance if it is used in a portable device that is movedfrom water feature to water feature, the information may be stored involatile memory or alternatively an option to reset may be provided atstartup. Thus, a complete correction map or calibration table 620 of theprojection area within the boundary 370 is produced and stored foradjusting the projected image from the underwater projection system 100during operation of the underwater projector.

FIG. 6A shows a further system component or module view of thecontroller of the instant invention. In the exemplary embodiment, theinvention utilizes a touch screen display 440 in the GUI 400. Otherforms of controller may be utilized including wired, wireless,computers, tablets, network enabled devices, smart phones, Wi-Fi enableddevices, and the like. The instant exemplary embodiment utilizes a webaddressable server with the control software being downloaded onto atablet device GUI 400. The controller 120 interfaces with the wirelessserver, which in turn is coupled through a wireless connection throughthe projection system interface 650 to the controller on the underwaterimage projection system 100. The underwater projection system 100 in theexemplary embodiment shown also having an optional at least oneaddressable ambient light, for instance a high intensity/brightness LED(HBLED) for illuminating the pool with background or ambient lighting,which is controlled through the controller 120. In this way, eachindividual light and the underwater projection system would beaddressable by the controller and singularly controlled as an element ofthe system. Currently, to accomplish this control, each light is on ananalog switched system. That is, individual switches control power toand switch the state of the light. Using this system, a singleaddressable controller switches the light through a soft switch on thecontroller and this is interfaceable with the handheld controllerthrough a wireless network or wireless connection.

In FIG. 6A, components or modules of the control software of theexemplary embodiment are shown. Although this is representative of themodules for control as outlined above, additional modules and functionsmay be added or removed without departing from the spirit of theinvention. Likewise, although reference is made herein above to anetwork addressable control system, current technologies using switchedcontrols may also be used in conjunction with the software to controlone or more lights and the underwater projection system 100.

As seen in the figure, the instant invention comprises a GUI controller400 in communication with a system controller 600. The software in theexemplary embodiment depicted is located on the systems controller 120.However, it may also be located on the GUI 400 and its controller. Theexemplary embodiment show utilizes a projection border and imagecorrection routine module 610 to calibrate and establish the boundary370 of the projection area and produce a calibration table or correctionmap 620 as noted above. The data from this execution of this module inconjunction with the GUI controller 400 is stored as a calibration tableor matrix or correction map 620. The stored information can be containedin a non-volatile memory and retained after powering down. In this way,the adjustments remain until the user or the system promptsrecalibration, as noted above. Alternatively, recalibration may beforced at each startup, for instance if calibration utilizes sensors andis fully automated or may require an active election to save by a userand then saved into non-volatile memory. Content, such as image 520, issent into the system through a content module 630. This content may beuploaded to or streamed or otherwise provided through the content module630. The data from the content module 630 together with the calibrationmap 620 are then provided to the Dynamic Content Manipulator (DCM)module 640.

The DCM 640 is responsible for manipulating the data received form thecontent module 630 with the measurements made in the calibration tableor map 620. The data is essentially corrected for the calculatedvariances in the image as projected across the entirety of the boundedprojection area, as herein described above. The result of the data ofthe content module 630 being manipulated by the data of the calibrationtable or map 620 is a control output for the projection system 100 andis communicated through the projection system controller interface 650to the projection system controller. Additionally, the DCM 640 may alsoincorporate additional variables representing environmental variances.This can include, for instance, additional corrective variablesincluding at least one of a variable relating to placement, timing,display of the at least one boundary image or at least one variablerelating to data collected, stored, programmed or utilized forcalculations relating to the water feature or environmental informationon the water feature such as certainly not limited to water temperature,salinity, measure visibility, depth, material data, and the like.

FIG. 6B shows a further system component or module view of thecontroller of the instant invention with an automated data collectionmodule. The embodiment shown is similar to the embodiment of FIG. 6A.However, the embodiment of FIG. 6B provides for a further automated datacollection module 730 as discussed above in relation to FIGS. 2D and 2E.The added automated data collection module 730 communicates datacollected from the sensors shown in FIGS. 2D and 2E to the boundary andimage correction routine 610. As noted above, the data collected by theautomated data collection module 730 is thus communicated back to thesystem.

FIG. 7 shows a view of a first and second of an at least two underwaterprojection systems simultaneously operating. As shown, a first of an atleast two underwater projections systems 100A is shown projecting imagesA and B. A boundary marking function has been performed to establish,through a boundary marking module of the control software and an imagecorrection module 610 like that above, for the projection of images Aand B, collectively the first underwater projection systems images 380.The second of the at least two underwater projection systems 100B isshown similarly having completed a boundary marking function and imagecorrection module 610 functions. The result is the display of images Cand D, collectively referred to the corrected images of the secondunderwater projection system 390. A single GUI Controller interface 400is provided, however, multiple such GUI Controller interfaces may beutilized as well. In addition, the GUI Controller 400 is incommunication with an auxiliary, non-light amenity system, in this casea sound system. Additionally the controllers may control an at least oneambient light source, as noted in other embodiments described herein. Ininstances where more than one underwater image projector is provided, asingle controller 120 may also be utilized to control both underwaterimage projectors 100A, 100B.

When used in conjunction with one another, the at least two underwaterimage projectors have some unique control feature issues. Firstly,depending on the overall size of the pool and the boundariescircumscribed and stored on each controller, an additional step ofhandling overlapping projections must be included in any routinesconducted by either of the at least two underwater image projectionsystems 100A, 100B. For example, as A is moved it could pass tolocations outside of the boundary of the first underwater imageprojection systems, it may pass into the boundary of the other system.Thus, in addition to the DCM 640, an additional component must beprovided to handle “handoffs” between the projection areas. This isprovided in a separate module (not shown) that interrogates projectionposition data from each of the at least two under water projectionsystems 100A, 100B. The result is a seamless projection of a continuousimage across boundary lines or zones. It may also be that each of the atleast two under water projection systems 100A, 100B have definedprojection boundaries that overlap. In this instance, the at least twounder water projection systems 100A, 100B must be able to communicaterelative position and share markers. This avoids over wash or sudden anderratic fluctuations from projecting the same or conflicting images intoa single. Finally, in the configuration having at least two under waterprojection systems 100A, 100B, each system may simply operate as anindependent and autonomous control. This would potentially result indistortion on interlacing images if the projections project the same ordifferent things in the same spot.

In each case, the at least two under water projection systems 100A, 100Bmay communicate with the single GUI controller in order to perform themanipulations on their respective images 380, 390. Additionalinformation may be shared in the way of edge distortion values and thecalibration table or map, such that smooth transitions can be made ofthe images between each of the at least two underwater projectionsystems. Additionally, both lights may also be controlled by a singlecontroller 120, as shown above, controlling multiple underwater imageprojection systems.

The embodiments and examples discussed herein are non-limiting examples.The invention is described in detail with respect to exemplaryembodiments, and it will now be apparent from the foregoing to thoseskilled in the art that changes and modifications may be made withoutdeparting from the invention in its broader aspects, and the invention,therefore, as defined in the claims is intended to cover all suchchanges and modifications as fall within the true spirit of theinvention.

It will be appreciated by those skilled in the art that while theinvention has been described above in connection with particularembodiments and examples, the invention is not necessarily so limited,and that numerous other embodiments, examples, uses, modifications anddepartures from the embodiments, examples and uses are intended to beencompassed by the claims attached hereto. The entire disclosure of eachpatent and publication cited herein is incorporated by reference, as ifeach such patent or publication were individually incorporated byreference herein.

Various features and advantages of the invention are set forth in thefollowing claims.

The invention claimed is:
 1. An underwater projection system, theunderwater projection system comprising: a controller to: generate a mapbased on the boundary of a projection area, receive image content, andgenerate a control output based on the image content and the map; and aprojector in communication with the controller to project the controloutput through the fluid onto the projection area.
 2. The projectorsystem of claim 1, wherein the fluid is water and the controllergenerates the control output based on one or more of water temperature,water salinity, water visibility, and water depth.
 3. The projectorsystem of claim 1, wherein the projector is an underwater projector. 4.The projector system of claim 1, wherein the controller receives theimage content via a user interface.
 5. The projector system of claim 1,wherein the projector is a first projector and further comprising asecond projector in communication with the controller, wherein thecontroller is designed to transition projection of the control outputfrom the first projector to the second projector.
 6. An underwaterprojection system, comprising: a projector to project images onto aprojection area; and a controller in communication with the projectorto: transmit boundary shapes to the projector for projection onto theprojection area, receive boundary shape placement information, determinea projection area boundary based on the boundary shape placementinformation, generate a correction map based on the projection areaboundary, receive image content, generate a control output based on theimage content and the correction map, and transmit the control output toprojector for projection onto the projection area.
 7. The projectionsystem of claim 6, wherein the projector is an underwater projectordesigned for use in a water feature.
 8. The projection system of claim6, further comprising a memory, wherein the correction map and the imagecontent are stored in the memory.
 9. The projection system of claim 6,wherein to generate the control output, the controller adjusts the imagecontent across the projection area according to variance values of thecorrection map.
 10. The projection system of claim 6, wherein thecontroller receives the image content and the boundary shape placementinformation via a user interface.
 11. The projection system of claim 10,wherein a user adjusts placement of the boundary shapes in theprojection area via the user interface.
 12. The projection system ofclaim 10, wherein the controller is in wireless communication with theuser interface.
 13. A projection system for underwater use in a waterfeature, comprising: a projector to project images onto a projectionarea; a sensor to generate boundary information of the projection area;and a controller in communication with the projector and the sensor to:determine a projection area boundary based on the boundary information,generate a correction map based on the projection area boundary, receiveimage content, generate a control output based on the image content andthe correction map, and transmit the control output to the projector forprojection onto the projection area.
 14. The projection system of claim13, wherein the projector is an underwater projector.
 15. The projectionsystem of claim 13, wherein the controller determines the projectionarea boundary using edge detection.
 16. The projection system of claim13, wherein to generate the control output, the controller adjusts theimage content across the projection area according to variance values ofthe correction map.
 17. The projection system of claim 13, wherein thecontroller receives the image content via a user interface.
 18. Theprojection system of claim 17, wherein the controller is in wirelesscommunication with the user interface.
 19. The projection system ofclaim 13, wherein the sensor is a passive sensor.
 20. The projectionsystem of claim 13, wherein the sensor is an active sensor.